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ABSTRACT 
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field test of the Inquiry Role Approach (IRA) to biology teaching 
developed by the staff of the Mid-Continent Regional Educational 
Laboratory (McREL) , Kansas City, Missouri. This paper contains a 
report of the students' cognitive, affective, and social skills 
performance. The 1,300 students participating in the study were 
measured by using the Comprehensive Final Examination; Exploration in 
Biology-Topic 1, Bird Populations; Biology Student Behavior 
Inventory; Social Skills Checklists; and Attitude Checklists. In 
addition, students completed two of the eight instruments (verbal 
reasoning, numerical ability) from the Differential Aptitude Test 
(DAT) battery, to provide a measure of general learning ability. The 
control group was found to be superior to verbal and numerical 
ability as measured by the DAT. Nevertheless, the IRA student groups 
had significantly superior posttest scores in cognitive inquiry and 
affective qualities of inquiry. The control group demonstrated 
significantly higher development in the area of biology content 
knowledge (BSCS Yellow Version) than did the IRA students. Results 
appeared to indicate that the IRA program was an effective teaching 
approach for developing cognitive inquiry skills and affective 
qualities of inquiry, both of which are considered important goals of 
science teaching. (Authors/PEB) 
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Introduction - 



The Inquiry Role Approach (IRA) is a method of teaching secondary biology 
which includes teacher training materials, teacher instructions for class use 
and student materials. Although the goals of IRA include the learning of biology 
content--factual information, concepts, and principles of biology--the goals 
emphasize inquiry skill development, social interaction skill, and attitude 
development necessary for good inquiry. The IRA method is based on the premise 
that biology content understanding, inquiry skills, social skills, and attitudes 
are interdependent and can be achieved best in a program that integrates them. 
The beginning point and developing rationale for this "four-pronged" approacn 
have been reported previously (Seymour, £t al^. » 1970; Bingman and Koutnik, 1970; 
and Koutnik, 1970). 

Problems Studied 

The 1972-73 field test v/as undertaken to resolve four problems: Can the 
adequacy of IRA implementation be described in terms of teacher practices? Do 
students in classes in v/hich IRA is implemented demonstrate the knov/ledge and 
skills which the program materials are designed to develop? Does student 
performance in IRA classes compare favorably with student performance in non-IRA 
classes? What recommendations for revision o*^ program materials would be indicated 
by the field test? The first of these genei ol problems v/as addressed in the 
first of the three papers in this paper set (Seymour, et al . , 1974a). The 
sub-problem and hypotheses studied in the 1972-73 IRA fieTJ test, which relate to 
the remaining three general problems above, will be discussed in this paper. 
These sub-problems and hypotheses are: 

SUB-PROBLEM 1: Have IRA students, in classes where the program was at least 
adequately implemented, shown significant increases from pre- to posttesting in 
biology content knowledge, cognitive inquiry skills, and affective qualities of 
inquiry [as measured by the Comprehensive Final Examination (Biological Sciences 
Curriculum Study, 1965), Explorations in Biology-Topic 1 (Koos, et^ al^. , 197?), 
and Biology Student Behavior Inventory (BSBI)(Steiner, 1970)]? 

HYPOTHESIS 1: There is no significant gain from pre- to posttesting in biology 
content knowledge, cognitive inquiry skills, and affective qualities of inquiry 
for IRA students in classes where the program was at least adequately implemented. 

SUB-PROBLEM 2: Have IRA students, in classes where the program was at least 
adequately implemented, met minimum performance levels for demonstration of social 
skills and affective qualities of inquiry at interim and posttesting [as measured 
by the Social Skills Checklists, IRA student forms 121-4 and 214-4, and the 
Attitude Checklists, IRA student forms 121-5 and 214-5 (Bingman, £t al- , 1972)]? 

HYPOTHESIS 2: The mean scores of students in classes v/here IRA has been at least 
adequately implemented will not meet the criterion levels on the social skill and 
attitude checklists eHninistered at interim and posttesting. 

SUB-PROBLEM 3: Are there significant differences in IRA student outcomes in 
biology content knowledge, cognitive inquiry skills, and affective qualities of 
inquiry (measured by CFE, EIB-1, and BSBI, respectively) between students in the 
following groups: Students with verbal and numerical aptitude at the 75th 
percentile or above, from the 50th to the 74th percentile, from the 25th to the 
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49th percentile, and at the 24th percentile or below [percentiles based on 
Differential Aptitude Test- Ver bal and Numerical scores (Bennett, et aj^. , 1959)]? 

HYPOTHESIS 3: There is no significant difference in IRA student outcomes in 
biology content knowledge, cognitive inquiry skills, and affective qualities of 
inquiry for students with different verbal and numerical aptitudes. 

SUB-PROBLEM 4: Are there significant differences in student outcomes in biology 
content knowledge, cognitive inquiry skills, and affective qualities of inquiry 
(measured by CFE, EIB-1, and BSBI, respectively) between students in Inquiry Role 
Approach classes and students in non-Inquiry Role Approach classes? 

HYPOTHESIS 4: There is no significant difference in student outcomes in biology 
content knowledge, cognitive inquiry skills, and affective qualities of inquiry 
among students grouped by: classes of IRA teachers using the BSCS Yellow Version 
text (Biological sciences Curriculum Study, 1968a), classes of experienced IRA 
teachers (that is, having previous experiences using IRA) using the BSCS Blue 
Version text (Biological Sciences Curriculum Study, 1968b), and classes of non- 
IRA teachers using the BSCS Yellow Version text. 

• 

SUB-PROBLEM 5: What revisions in the program materials are indicated by the 
results of testing, student feedback, and teacher feedback? 

Choosing Participants -- 

During spring. 1972, a letter seeking participants for the 1972-73 field 
test was sent to secondary biology teachers, school administrators, and other 
educators— col lege and university personnel, state boards of education personnel, 
etc. The field test would involve not only classroom teachers, but also trainers 
of teachers— department chairmen or curriculum supervisors--and, possibly, 
individuals such as university personnel to train the teacher trainers. 

Accompanying the letter was a brief description of IRA and a questionnaire 
which sought such identifying information as whether or not the person was 
interested in participating in the field test, in vdiat capacity, and if he could 
suggest additional persons to contact. 

The initial mailing was sent March 22, 1972 to 47 persons in 16 states. 
Most individuals were in the McREL region (31 in Kansas, Missouri and Nebraska) 
and some had had previous involvement with the IRA program. 

Lists of secondary biology teachers using the BSCS Yellow Version textbook 
in Missouri, Kansas and Nebraska were requested from the respective state 
departments of education. Partial lists were received and letters were sent 
to selected teachers (77 in Missouri, 10 in Kansas, 16 in Nebraska) during the 
month of April. It was found that the lists received were not current. 
Responses from these mailings were poor, apparently due to the dated information 
received from the state departments of education. About 10 additional teachers 
were contacted in various areas as a result of referrals returned to McREL by 
persons contacted in the initial mailings. Selection of participants from the 
questionnaire respondents was guided by the following criteria. 
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Guidelines for Selection of Field Test Participants — 

!• A Distribution of Test Sites and a Variety of Trainers. 

Z. A Variety of Test Site Socio-economic Settings. 

3. Heterogeneity of Student Abilities. 

4. Adequate Sample Size: Krejcie and Morgan (1970) have developed a table 
based on a formula published by the National Educational Association 
(1960) for determining sample size in research activities. This table 
shows that the size of the teacher sample ia the field test v/ould not allow 
for generalization to a large teacher population. For example, a maximum 
of 40 teachers might be included; results with a sample of 40 can only be 
generalized to a population of 45. Therefore, our teacher sample size was 
determined by other factors— program staff and funding capabilities-- 
rather than general izability considerations. 

On the other hand, Krjecie and Morgan note: "As the population increases 
the sample size increases at a diminishing rate and remains relatively 
constant at slightly more than 380 cases." A Selection of entries from' 
Table 1 easily demonstrates this: 

TABLE 1: Population Size Related to Sample Size 



N (POPULATION SIZE) 


S (SAMPLE SIZE) 


1000 


278 


2000 


322 


5000 


357 


10000 


370 


20000 


377 


30000 


379 


40000 


380 


50000 


381 


75000 


382 


1000000 


384 



Therefore, to have the freedom of generalizing to almost any, size population 
of similarly characterized secondary biology students j the student sample 
in the field test should be no less than 400. This figure was exceeded by 
1 ,000 students. 

As of July 31, 1972, the beginning of the IRA workshop at McREL, the field 
test participants included: (1) 4 teachers who would also train other teachers 
with 11 teachers using IRA but not responsible for training others; (2) 4 
teachers without a trainer; (3) approximately 1,750 students in 65 class sections; 
and (4) 10 schools in 6 states. 

In addition to these participants, eight teachers not u'sing IRA materials, 
v/ere asked to administer to their classes the battery of evaluation instruments 
used in the IRA classes. These teachers and their classes were the non-randomly 
assigned control group; approximately 465 students were included. These students 
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were similar to the test group IRA students in terms of heterogeneous grouping 
and other factors previously stared. The teaciiers were also similar to tlie 
test group teachers in terms of the textbook they used, experience in teaching, 
and general teaching approach. The primary difference was the lack of IRA 
materials and training for the control teachers. Pre- and posttests were 
administered in classes of four of the teachers; only posttests v/ere administered 
in classes of the remaining four teachers. 

Participating Teachers : All but 1 of the 15 field test participants had 
previous teaching experience and previous experience using the BSCS Yellow 
Version textbook. The teaching experience of the participants is summarized in 
Table 2. 

TABLE 2: Years Teaching Experience of Field Test Participants 



YEARS EXPERIENCE 


NO. OF TEACHERS 


TEACHER # 


0 - 2 

3-5 

6 - 9 
10 - 15 
16 or more 


1 
5 
2 
3 
4 


11 

10, 12, 13, 31 & 22 
02 & 01 
04, 30 & 14 
40, 20, 21 & 03 



Note that the one inexperienced teacher v/orked in a team' 
teaching setting with four other experienced teachers. 



These teachers have also been categorized according to the type of IR/. 
training .they received. (See the first paper of this paper set.) 

Participating Students : IRA is designed for students with abilities and achievement 
in the 3Dth to 99th percentile range as measured by the Differential Aptitude Test- 
Verbal and Numerical . Inclusion of students falling below the 30th percentile 
should not affect the success of the program, neither overall or for those 
students below the 30th percentile, as long as the student groups are heterogeneous 
and the percentage of students below the 30th percentile remains low. 

Mean percentile for students in the 1972-73 field test, according to DAT 
Verbal and Numeric&l scores, are given in tables 3 and 4. 



TABLE 3: Mean Percentile for 
Scores on DAT-Verbal 
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MEAN RAW 


MEAjN' 


SITE 


H 


SCORE 


PERCENTILE* 


A 


97 


34.27 


75 


B 


508 


28.22 


57 


C 


203 


29.89 


63 


D 


203 


31.77 


68 


E 


141 


24.03 


43 


F 


131 


27.24 


55 


G 


51 


28.47 


' 58 


. H 


19 


31 .79 


68 


Total 


1353 


29.01 


60 



*10th grade, first semester norms applied. 
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TABLE 4: Mean Percentile for 

Scores on DAT-Numerical 







MEA.N RAW 


MEAfi 


SITE 


N 


SCORE 


PERCENTILE* 


A 


94 


26.56 


63 


B 


456 


18.11 


30 


c 


206 


23.13 


48 


D 


195 


24.48 


53 


E 


124 


17.73 


27 


F 


129 


21 .57 


42 


G 


51 


22.51 


45 


H 


18 


22.89 


47 


Total 


1273 


21.08 


40 



*10th grade, first semester norms applied. 



The DAT-V mean for the entire IRA sample was 29.01, as reported in Table 3, 
and the percentile rank for this mean v;as 60. The median v/as 29.00 and the mode 
was 28.00. Thus these scores v/ere probably normally distributed. The minimum 
score was 7 and the maximum was 48 on this 50-item test. The standard deviation 
was 9.94. Thus 84.38 percent of the 1?A students had verbal scores at or above 
the 30th percentile on the DAT- Verbal test. 

The mean, median, mode, minimum, maximum, and standard deviations were 
21.12, 21.00, 18.00. 1.9. 40.0, and 8.18, respectively, for all IRA students on 
DAT-iJ. Thus 64.4 percent o^ the IRA students had numeric scores at or above 
the 30th percentile on the DAT-Numerical test. 

All students v/ere in their first year biology classes using the BSCS Yellow 
Version text. Students at Site E vyere ninth graders; at Site A, students were 
primarily 11th graders; at all other sites, students were all, or primarily, 
tenth graders. A large percent of students at Sites B, E, F, and 6 were below 
the 30 percentile range. This was higher than preferred. 

Control Group Participants : All teachers in the control groups were experienced 
teachers. Classes included were first year biology using BSCS Yellow Version 
texts composed of all or primarily tenth grade students. Four of the control 
teachers tested at the beginning and end of the school year; four others tested 
only at the end : ^ the year* 

A description of the student populations at the control sites according to 
DAT scores is given in Tables 5 and 6. 

TABLE 5: Control Students Percentile Group 

Distribution According to DAT-Verbal Scores 







MEAN 






STUDENT 


RAW 


MEAN 


SITE 


N 


SCORE 


PERCENTILE* 


A 


145 


35.41 


77 


C 


55 


29.78 


65 


E 


51 


29.53 


63 


H 


66 


30.98 


65 


I 


148 


33.10 


70 



ERJC *10th grade, first semester norms applied. 
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TABLE 6: Control Students Percentile Group 

Distribution According to DAT-Numerical Scores 







MEAN 






STUDENT 


RAW 


MEAi^ 


SITF 


N 




PFPrFMTTI F* 

r L t\LLIt 1 1 Ll, 


A 


145 


29.21 


75 


C 


55 


24.98 


57 


E 


51 


24.55 


55 


H 


66 


24.47 


55 


I 


148 


25.95 


62 



*lDth grade, first semester norms applied. 

Experienced IRA Teachers : Four teachers in the Kansas City area have participated 
for five years (1968-69 through 1972-73) in the testing and development of the 
Inquiry Role Approach program. They were experienced with prototype IRA materials 
keyed to the BSCS Blue Version text. During the 1972-73 school year, these 
teachers adapted the IRA field test materials, keyed to the BSCS Yellow Version 
text, to the Blue Version text. While the emphasis of the field test focused 
on the results in classes of teachers using the Yellow Version text, evaluation, 
instruments v/ere administered to stuu^nt samples of each of these experienced 
teachers when possible. 

A description of the students populations of these experienced IRA teachers 
according to DAT scores is given in Tables 7 and 8. 

TABLE 7: Experienced IRA Teachers' Students TABLE 8: Experienced IRA Teachers' Students 
Percentile on DAT- Verbal Scores Percentile on DAT-Numerical Scores 



TEACHER 


STUDENT 
N 


MEAN RAW 
SCORE 


MEAN 

PERCENTILE* 




TEACHER 


STUDENT 
N 


MEAN RAW 
SCORE 


MEAN 

PERCENTILE* 


61 


17 


30.1 


63 




61 


17 


23.4 


49 


62 


28 


32.5 


70 




62 


28 


26.7 


64 


63 


72 


31.8 


69 




63 


72 


24.2 


53 


64 










64 









Students were in first year biology. Students of Teacher 63 were all 
in ninth grade. Students of the other teachers were all or primarily 
tenth graders. 



Instrument s -- 

The Comprehensive. Final Examination , Exploration in Biology-Topic 1 , Bird 
Populations, and Biology Student Behavior Inventory have been described in the 
first paper of this paper set. The Social Skills Checklists and Attitude 
Check! ists have been described in the second paper of this paper set (Seymour, 
et ai., I974b). 

Differential Aptitude Test : The DAT (Bennett, et_ al- , 1966) is a battery of 
instruments designed to measure student aptitude in eight areas. Two of the 
eight instruments -- Verbal Reasoning and Numerical Ability -- are often used 
together as a measure of general learning ability (DAT manual, p. 1-7). Only 
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these two instruments of the DAT battery were used in the field test. These 
were administered in the fall of the year to establish a base for comparison 
made betv/een groups in the field test and for comparing the field test group 
as a total with outside populations. 

Validity : A large number of studies have been performed relating course grades 
for varilDUS subjects to DAT scores. It was adequate for our purposes to note 
that of the coefficients of correlation computed for science grades compared to 
the nine DAT scores (8 instruments and the Verbal Reasoning + Numerical 
Reasoning composite score), the highest coefficients were found for Verbal 
Reasoning (.45), Numerical Ability (.44) and the VR+NA composite (.52). 

Validation by a 3-1/2 year longitudinal study was also performed. This 
study indicated that DAT scores remain predictive of student performance over 
a long range. For example, DAT VR and NA scores from students 8th grade 
(mid-year) correlated well with general science grades achieved at end of 8th 
grade (VR - science grades, r = .64; NA - science grades, r = ,59); these 8th 
grade DAT scores still correlated well with science (physics) grades achieved 
at end of 11th grade (VR - physics grades, r = .59; NA - physics grades, r = ,60). 

A most important means of validating the DAT was in appraising its predictive 
ability of student results on achievoir.cnt tests. Some examples of the coefficients 
of correlation found between DAT-VR, uAT-NA and DAT-VR+NA scores and various 
achievement tests are given in the following table: 

TABLE 9: Coefficients of Correlation Betv/een 
DAT-VR, DAT-NA, and DAT-VR+NA scores 
and various achievement tests 





COEFFICIENTS OF CORRELATION 


TEST 


BOYS 


GIRLS 




H 


VR 


NA 


VR+NA 


N 


1 VR 


NA 


1/R+NA 












Iowa Test of Basic 
Skills - Form 1 - 

Reading Comprehension 


125 


.62 


.61 


.69 


117 


.68 


.61 


.73 


Arithmetic Total 


125 


.71 


.69 


.80 


117 


.53 


.75 


.76 


Iowa Tests of Educational 
Development - Form Y4-FL 
Composite 


93 


.91 


.85 


.92 


79 


.89 


.76 


.89 


Stanford Achievement 
Test - Form KM, 
Intermediate Level - 
Battary Median 


74 


.84 


.84 


.91 


71 


.82 


.90 


.92 



In general, the OAT scores have shov/n high correlations with achievement 
tests measuring comparable skills and knowledge. 

Reliability ; Reliability was studied using the split half technique with the 
computed correlation coefficients corrected by the Spearman-Brown formula. The 
VR, NA, and VR+NA coefficients (given separately for form L and M, for boys and 
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girls, and for each grade 8 through 12) range from ,83 to •96, The tenth grade 
values for Form L are: for boys, Verbal Reasoning, r = .OS, Numerical Ability, 
r = .91, VR+NA, r = ,95; for girls. Verbal Reasoning, r = ,94, Numerical Ability, 
r = .91, VR+NA, r = .96. 

The long term consistency of measurement by the DAT v/as studied by determining 
the correlation between 9th grade scores and 12th grade scores for the same set 
of students studied over the three year period. Verbal Reasoning coefficients 
of correlation v/ere .87 for boys (N = 71) and .82 for girls (N = 90); Numerical 
Ability coefficients for tiiese same groups v/ere .75 for boys, .74 for girls. 
This study utilized DAT - form A. 

Correlation to other tests : The DAT correlates v/ell with most standard intelligence 
tests. Some examples of the coefficients of correlation found between DAT-VR, 
DAT-NA and DAT-VR+NA scores and various intelligence tests are given in the 
following table: 



TABLE 10: Coefficients of Correlation Betv/een 
DAT-VR, DAT-liA, and DAT-VR+NA Scores 
and Various Intelligence Tests 





COEFFICIENTS 0 


F CORRELATION 


TEST 


BOYS 


GIRLS 




N 


VR 




VR+IIA 


N 


VR 




VR+i>IA 


Lorge-Thorndike 
intelligence tests 
(Form A, Level 4) - 
Taken in 11 th grade. 


















Verbal 


58 


.70 


.60 


.72 


59 


.85 


.78 


.86 


Non-Verbal 


58 


.61 


.57 


.64 


59 


.72 


.69 


.74 


School and College 
Ability Tests (Form 2A 


















Verbal 


71 


.82 


.57 


.78 


59 


.83 


.64 


.80 


Quantitative 


71 


.67 


.83 


.81 


59 


.77 


.82 


.85 


Total 


71 


.85 


.79 


.90 


59 


.87 


.77 


.89 



Data Analysis and Interpretation- - 

Data Processing : The general sequence of data processing was as follov/s: 

!• Distribution of measuring instruments and instructions to field test 
participant teachers. 

2. Administration of instruments by teachers. 

3. Collection of data by McREL. 

4. Scanning or key punching data onto cards. 
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5* Scoring of instruments. 

6. Analysis of scores per various groups of subjects* 

This basic sequence was repeated three times during the field test to 
obtain pretest data, interim data after Theme I and posttest data. A brief 
description of data collected and the approximate times these data v/ere collected 
are indicated in Chart I. 

The statistical processing of data collected during the field test was 
performed on computers located at the University of Missouri -Columbia (IBM 370/ 
165) and at the University of Kansas (Honeywell 635). For information concerning 
the particular programs used for the different analyses performed, see Table 11. 
In a few instances, post hoc analyses v/ere computed on desk calculators. All 
analyses were performed using the student as the sampling unit. 

CHART I: Data Collection for IRA Field Test 1972-73 



PRETESTING 
September, 1972 

Differential Aptitude Test - Verbal Reasoning and Numerical Ability 
Comprehensive Final Examination - Form J 
Exploration in Biology-Topic 1. Bird Population 
Biology Student Behavior Inventory 

INTERIM (END OF THEME I) TESTING 
December, 1972 - January, 1973 

Class Activities Questionnaire 
Views and Preferences - Form C 

Explorations in Biology - Topic 2. Food Preferences of 

Newly-Hatched Snakes 
Social Skills Checklist (IRA student form 121-4) 
Attitude Checklist (IRA student form 121-5) 
Understanding Role Responsibilities (IRA student form 121-3) 
A biology content test designed by the teacher 

POSTTESTING 
Kay-June, 1973 

Comprehensive Final Examination - Form K 
Explorations in Biology - Topic 1. Bird Populations 
Biology Students Behavior Inventory 
Class Activities Questionnaire 
Views and Preferences - Form C 

Social Skills Checklist (IRA student form 308-1, 3 teachers; 

.IRA student form 214-4, 11 teachers) 
Attitude Checklist (IRA student form 308-2, 3 teachers; 
IRA student form 214-5, 11 teachers) 
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TABLE 11: Listing of Computer Programs 
Used for Data Analyses 



Thi^ PRDf^RAM \./^C ncoH 4-n nKfa-Jn 

III ID rr\vj\3r\r\) 1 \/ab UbcU tO ODLain 


Lm 5 Mli/\L Tolo ZO support tn 1 S n i rU l ntolo • ^ 


DATSCOR 




BSBSCOR 




EIBSCOR 


SCORED 


DADTDI l:' 

rAK 1 r UU 


r\ 1 l*7"0 1 1*7" 

OUTPUT 


cr\ nT / 1 « \ 
oUKI \U) 




CONDENS 




MISDATA 


Analysis of variance 1; Pre-sensi tizati on 


dMD04V 


Analysis of Covariance 
and Newman-Keuls Post 
Hoc analysis* 3 


SFA41D 


Correlations Correl ations 


Tf^OT A *T" 

TESTAT 


ITEM Analysis Reliability data 

for EIB & BSBI 


MliU VMrx 1 


Analysis ot variance 
and Nev/man-Keuls 






A Posteriori analysis 4 


VAPSCOR 


i^an. Criterion level 
classi fication** 


SUMCTAB 


Descriptive statistics 2 



* Also used for study of student outcomes vs. degree of implementation reported 

in paper one of this paper set. 
**Used for description of degrees of implementation reported in paper one. 



SUB-PROBLEM 1: Have IRA students, in classes where the program was at least 
adequately implemented, shown significant increases from pre- to posttesting 
in biology content knowledge, cognitive inquiry skills, and affective qualities 
of inquiry (as measured by the Comprehensive Final Examination , Ex plorations in 
Biology-Topic 1 . and Biology Student Behavior Inventory )? 

HYPOTHESIS 1: There is no significant gain from pre- to posttesting i» iology 
content knowledge, cognitive inquiry skills, and affective qualities of inquiry 
for IRA students in classes where the program was at least adequately implemented. 

Data Ana lysis/ Results : In order to determine whether or not there viere any 
significant gains from pretest to posttest for any of the student outcome variables, 
an analysis of variance, non repeated measures, was computed for each variable. 
The results of these analyses are presented in Table 12. Note that this objective 
and hypothesis dealt only v/ith students In classes where IRA was at least 
adequately implemented. Therefore, data from teacher 01 were not included in 
any of these analyses. 
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TABLE 12: Number of Students, Pretest and Posttest Means, 
F Ratios, and Probability Levels for Student 
Outcome Variables (Analysis of Variance, Non- 
Repeated Measures) 





PRETEST 


N 


POSTTEST 


N 






WAPTAPI F 


MPAiJ 
rlLnli 


PRF 






F RATIO 


P 














FIR lA* 


1 o • 


DOO 


C.U . DO 


O 1 c 


36.1 


.0000 


EIB IB** 


35.86 


573 


40.90 


786 


113.6 


.0000 


BSBI A Curiosity 


2.60 


580 


2.71 


519 


7.53 


.006 


BSBI B Openness 


3.52 


580 


3.70 


519 


15.66 


.0003 


BSBI C Satisfaction 


3.58 


580 


3.53 


519 


1.74 


.18 


BSBI D Responsibility 


3.55 


580 


3.85 


519 


21.57 


.0000 


BSBI Total Score 


13.25 


580 


13.79 


519 


17.08 


.0002 


CFE 


17.56 


589 


19.64 


777 


40.39 


.0000 



* EIB-IA is a subscore of EIB 1 which includes EIB subscales I, III, and 

12 items from subscale IV. 

** EIB-IB is a subscore of EIB 1 which includes 12 additional items from 

subscale IV and subscales V and VI. 



As can be noted from Table 12, seven of the eight F ratios v/ere significant 
beyond the .01 level. All of the differences were in a positive direction. Thus 
these analyses indicate the null hypothesis can be rejected for all variables 
except BSBI subscale C (satisfaction). 

Inquiry Role Approach students, in classes v/here at least adequate implementation 
had occurred, scored significantly (P = less tFian .01) higher at the end of the 
school than at the beginning for: cognitive inquiry skills as measured by EIB-lA 
and EIB-lB; affective qualities of inquiry as measured by the BSBI total score 
and subscale A (Curiosity), B (Openness) and D (Responsibility); and biology 
content knowledge as measured by the CFE. 

The design utilized for testing the hypothesis v/as a quasi-experimental design. 
Campbell and Stanley (1963) have noted that this design may be appropriate in field 
situations where equivalent or comparable control groups cannot be added. It is 
further characterized as tending toward superiority in external validity or 
general izability over "true'' experimental designs. Hov/ever the most important 
characteristic of this design for the purposes of this study was its ability to 
control for the effect .of taking a pretest upon the scores of a posttest. 

It should be noted that the design used here did not control for maturation— 
pre to post changes resulting from the passage of time rather than treatment. 
However, a modified Solomon Four-Group Design was used for Problem 4, and 
posttest only analyses were performed comparing experimental and control groups. 

For pretesting, students v;ere randomly distributed into two groups. Group 1 
was pretested with the BSBI and CFE Instruments; Group 2 v/as pretested with the 
EIB-Topic 1 instrument. All students were posttested with all three instruments. 
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Thus Group 2 students acted as a non-pretested control group for the BSBI and 
CFE instruments; Group 1 students acted as a non-pretested control group for the 
EIB-1 instrument. An analysis of variance was computed betv/een those students 
who had the pretest for each variable and those students v/ho did not have the 
pretest. The results of these analyses are presented in Table 13. 



TABLE 13: Posttest Mean Scores and F Ratios for Comparison 
of Students With and Without Pretests 







PRETESTED 


HOT PRETESTED 






TEST 




(GROUP 1) 


(GROUP 2) 










MEAN 


N 


MEAiN 


N 


F 


p 












EIB 


III 


n .20 


399 


11.41 


432 


.67 


.58 


EIB 


IV 


17.61 


339 


17.36 


361 


.95 


.67 


EIB 


V 


23.96 


398 


23.24 


426 


3.40 


.06 


EIB 


VI 


6.81 


387 


6.82 


415 


.02 


.89 


EIB 


Total 


60.63 


339 


60.35 


361 


.11 


.74 






PRETESTED 


NOT PRETESTED 






TEST 




(GROUP 2) 


(GROUP 1) 










MEAN 


N 


MEAi'^ 


N 


F 


P 










BSBI 


A 


2.70 


214 


2.70 


378 


.02 


.89 


BSBI 


B 


3.64 


214 


3.63 


378 


.02 


.89 


BSBI 


C 


3.50 


214 


3.57 


378 


1.38 


.24 


BSBI 


D 


3.67 


214 


3.71 


378 


.17 


.69 


BSBI 


Total 


13.51 


214 


13.60 


378 


.18 


.67 


CFE 




18.74 


406 


19.20 


393 


1.02 


.31 



The results Indicate that there were no significant differences between the 
two groups on any of the posttest scores. As can be noted in Table 13, the mean 
for the two groups were very close and in all cases except for the EIB 3 part 
score, the group v/hich did not have the pretest scored slightly but not signifi- 
cantly higher than the group of students who had the EIB test as a pretest. 
For the BSBI scores, the mean were again very close and the group of students 
with the BSBI as a pretest scored slightly but not significantly higher on two 
of the part scores and the total score. As noted above, none of these differences 
were significant at the .05 level of significance. For the CFE, the group of 
students who had the CFE as a pretest scored about half a point higher than the 
group of students who did not have this test as a pretest, but again the difference 
was not significant at the .05 level. 

SUB-PROBLEM 2: Have IRA students, in classes where the program was at least 
adequately implemented, met minimum acceptable performance levels for demonstration 
of social skills and affective qualities of inquiry at interim and posttesting 
(as measured by the Social Skills Checklists, IRA student forms 121-4 and 214-4, 
and the Attitude Checklists, IRA student forms 121-5 and 214-:5)? 

HYPOTHESIS 2: The mean scores of students in classes where IRA has been at 
least adequately implemented will not meet the criterion levels on the social 
skills. and attitude checklists administered at interim and posttesting. 
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Analyses/Resul ts : The social skills and attitude checklists have been developed 
to be specific measures for the sets of social skills and attitudes which the 
IRA program is designed to foster in students. These are unlike the non-IRA 
specific instruments discussed previously (Comprehensive Final Examination, 
Explorations in Biology, and Biology Student Behavior Inventory) and are used 
to measure student pre-to-post gains in biology content knowledge, cognitive 
inquiry skills, and selected inquiry attitudes. The social skills and attitude 
checklists are criterion referenced measures. It 1s felt that the use of these 
instruments would not be particularly appropriate as pre-to-post gain or IRA 
vs. Non-IRA measures. 

The development of these instruments has been discussed in the second paper 
of this paper set (Seymour, et^ al^. , 1974b). 

All teachers administered the Theme I social skills and attitude checklists 
(121-4 and 121-5), Table 14 presents the data from this testing. 

TABLE 14: Social Skill Checklist and Attitude 
Checklist Data from End of Theme I 





Students ' Mean Score 


Students ' Mean Score 


TEACHER NO. 


Social Skil 


1 Checklist 


Attitude Checklist 




121-4 




121-5 






J 


N 


I 


N 










02 


43.2 


24 


48.4 


23 


03 


40.2 


22 


46.6 


22 


04 


49.4 


26 


* 


* 


20 


33.4 


77 


41 .7 


82 


21 


35.9 


20 


44.4 


20 


22 


41 .0 


20 


45.6 


20 


23 


42.4 


26 


49.4 


26 


30 


38.8 


26 


43.0 


27 


31 


43.2 


25 


51.1 


25 


40 


42.0 


103 


47.0 


103 


Cri terion 


28.0 




33.0 



* No data submi tted. 



Teachers sent raw data (students* checklists) to the IRA staff. Random 
samples (20-25 papers per teacher) v/ere taken from each teacher^s data submitted 
for calculating these means. Note that teacher 40 had calculated mean scores for 
all 103 students completing the instruments. Note that in all cases students* 
mean score exceeded the criterion level. 

Note that teacher 01, who did not adequately implement the program, is not 
included in this data. However this teachejr's students did meet criterion on 
these instruments (121-4, X = 33-8; 121-5, X =^ 43.7). 

Teachers varied in the number of IRA activities each completed. (See paper 
one in this paper set.) As a result, posttesting with social skill and attitude 
checklists was not uniform. Some teachers administered Theme II checklists 
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(214-4 and 214-5) during the second semester but before the posttesting. Some 
administered Theme II checklists as part of the posttesting. And at least one 
teacher administered the Theme III checklists (308-1 and 308-2) as part of the 
posttesting, having administered the Theme II checklists earlier in the semester. 

Responsibility was given to the teachers to summarize social skill and attitude 
checklist data collected during the second semester, rather than having raw 
data submitted. In retrospect, data collection emphasis was placed on those 
measures used for pre-to-post gain and IRA vs. non-IRA comparison studies. 
Social skill and attitude checklist data was not properly reported by teachers. 
Eight teachers (02, 03, 10, 11, 12, 13, 14, and 21) submitted raw data (student 
papers) for Social Skills Checklist 214-4 and Attitude Checklist 214-5. A 
random sample of 50 was selected for each instrument; data from this sample is 
given in Table 15. 



TABLE 15: Social Skill Checklist and Attitude 
Checklist Data from End of Theme II 





X Score 


N 


Criterion 
Score 


S 


T 


Social Skills 
Checklist 214-4 


71 .8 


50 


53 


13.3 


10.1* 


Attitude 
Checklist 214-5 


58.3 


50 


43 


11.4 


9.5 



* P .0005 one tailed 



Thus the mean scores for a student sample representing nine of the 14 
teachers who adequately implemented the program well exceeded the criterion 
levels. Among the 50 students in the social skills checklist sample, only 3 
(6^) failed to meet criterion. In the attitude checklist sample, 4 (8%) failed 
to meet criterion. Two t-tests were calculated to determine if the mean scores 
were significantly larger than the criteria levels. Results (see Table 15) 
were such that the null hypothesis, hypothesis 2, can be rejected. IRA students 
did meet criterion levels on the social skill and attitude checklists. 

SUB-PROBLEM 3: Are there significant differences in IRA student outcomes in 
biology content knowledge, cognitive inquiry skills, and affective qualities 
of inquiry (measured by CFE, EIB-1 , and BSBI, respectively) between students 
in the following groups: Students with verbal and numerical aptitude at the 
75th percentile or above, from the 50th to the 74th percentile, from the 25th 
to the 49th percentile, and at the 24th percentile or below (percentiles based 
on Differential Aptitude Test-Verbal and Numerical scores)? 

HYPOTHESIS 3: There is no significant differences in IRA student outcomes in 
biology content knowledge, cognitive inquiry skills, and affective qualities of 
inquiry for students with different verbal and numerical aptitudes. 

Data Analyses/Results : The analysis of covariance was used to determine whether 
or not there v/ere any significant differences in student outcomes variables 
(EIB-subscalf^ I not included) among the four subgroups based on both the DAT- 
Verbal 'and the DAT-Numerical scores. Pretest scores were held constant for. 
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each variable analyzed. The results of these analyses are presented in Tables 
16 and 17. The Newman-Keuls analysis v;as used to determine which pairwise 
differences were significant; these results are presented In Tables 18 and 19. 

TABLE 16: Adjusted Means and F Ratios for Comparing Student 

Subgroups Based on Quartiles on DAT- Verbal Reasoning 



VARIABLE 



FIRST 
QUARTILE 
ADJUSTED 
MEAN N 



SECOND 
QUAR TILE 

MEAN N 



THIRD 
QUARTILE 

ADJUSTED 
MEAN N 



FOURTH 
QUARTILE 
ADJUSTED 
^SEAlN N 



F RATIO 



EIB III 
EIB IV 



EIB 
EIB 



V 
VI 



EIB Total 

BSBI A 

BSBI B 

BSBI C 

BSBI D 

BSBI Total 

CFE 



10.19 
15.69 
18.89 
5.80 
53.59 

2.54 
3.45 
3.38 
2.91 
12.46 



35 
27 
38 
34 
27 

21 
21 
21 
21 
21 



10.07 
16.83 
20.26 
6.87 
54.45 

2.52 
3.43 
3.37 
3.35 
12.76 



51 
33 
42 
38 
33 

48 
48 
48 
48 
48 



12.02 
17.66 
23.51 
6.76 
60.79 

2.67 
3.60 
3.49 
3.72 
13.51 



82 
66 
93 
88 
66 

65 
65 
65 
65 
65 



12.78 
19.00 
27.27 
7.61 
68.17 

2.77 
3.76 
3.65 
3.90 
13.94 



117/ 
90 
109 
10f> 
90 
82 

nz 

82 
82 
82 
82 



16.11 25 



18.41 45 



17.27 72 



19.89 98 



13.06** 
10.54** 
40.25** 
9.67** 
34.38** 

1 .90 

3.05* 

2.98* 

6.52* 

5.26* 

3.68* 



* Significant at .05 level 
** Significant at .01 level 



TABLE 17: Adjusted Means and F Ratios for Comparing Student 

Subgroups Based on Quartiles on DAT-Numberial Ability 





FIRST 


SECOND 


THIRD 


FOURTH 






QUARTILE 


QUARTILE 


QUARTILE 


QUARTILE 






ADJUSTED 


Adjusted 


ADJUSTED 


ADJUSTED 




VARIABLE 


MEAN 


N 


MEAN 


N 


MEAN 


N 


MEAN 


N 


F RATIO 












EIB III 


11.11 


86 


11.72 


67 


12.01 


96 


13.06 


21 


2.41 


EIB IV 


16.18 


61 


17.32 


52 


18.79 


81 


19.69 


19 


13.03** 


EIB V 


21.09 


85 


22.99 


75 


25.96 


94 


28.13 


22 


17.81** 


EIB VI 


6.63 


76 


6.82 


72 


7.29 


41 


7.96 


20 


4.00* 


EIB Total 


56.41 


61 


60.26 


52 


65.22 


81 


69.26 


19 


14.64** 


BSBI A 


2.44 


52 


2.66 


68 


2.74 


78 


2.85 


17 


3.36* 


BSBI B 


3.46 


52 


3.59 


68 


3.72 


78 


3.52 


17 


1.97 


BSBI C 


3.40 


52 


3.51 


68 


3.53 


78 


3.65 


17 


.94 


BSBI D 


3.21 


52 


3.63 


68 


3.85 


78 


3.80 


17 


4.51* 


BSBI Total 


12.58 


52 


13.41 


68 


13.81 


78 


13.65 


17 


4.45* 


CFE 


. 16.21 


67 


17.80 


79 


19.82 


75 


21.62 


18 


6.35* 



Significant at 
** Significant at .01 level 
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TABLE 18: Newman-Keuls Post Hoc Analysis 
for DAT- Verbal Quartiles 



QUARTILE 


1ST 


1ST 


1ST 


OKI n 

2hD 


o r\ 

2ND 


^ n n 
3Ku 


PAIRINGS: 


2ND 


3RD 


4TH 


3RD 


4TH 


4TH 
















EIB 3 




** 




** 


** 




EIB 4 


** 


* 


* 




* 






icic 


icic 


icic 




icic 




EIB 6 






** 




** 




EIB Total 




ycyc 


IClC 




7C7* 




BSBI B 




* 










BSBI C 














BSBI D 




* 


** 




** 




BSBI Total 




* 


** 




* 




CFE 






* 









* Significant at .05 level 
** Significant at .01 level 



TABLE 19: Newman-Keuls Post Hoc Analysis 
for DAT-Numerical Quartiles 



QUARTILE 


1ST 


1ST 


1ST 


2ND 


2ND 


3RD 


PAIRINGS: 


2ND 


3RD 


4TH 


3RD 


4TH 


4TH" 
















EIB 4 




* 


* 


** 


* 




EIB 5 




** 


** 


** 


** 




EIB 6 




* 


** 








EIB Total 




** 


** 


* 


** 




BSBI D 






* 




* 




BSBI Total 














CFE 




* 


** 









* Significant at .05 level 
** Significant at .01 level 



As indicated in Tables 16 and 17, all but one of the F ratios for the total 
and four subscale scores on the EIB were significant; all but three of the F 
ratios for the total and four subscale scores on the BSBI were significant; and 
the F ratios for the CFE were significant. Tables 18 and 19 indicate which of 
the pairwise comparisons were significant. It should be noted that, although 
the F ratios were significant for BSBI-subscale C compared to DAT-Verbal and 
BSBI-total score compared to DAT-Numerical, the Newman-Keuls analysis did not 
result in any significant pairwise differences. 

In order to further clarify the possible relationships between student 
outcome variables and DAT scores, correlation coefficients were computed between 
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each measure of student outcome and the DAT scores. Table 20 presents the 
results of this analyses, 

TABLE 20: Correlations Between Posttest Student Outcome 

Variables and DAT-Verbal and DAT-Numerical Scores 





r* 




r* 






DAT-V 


N 


DAT-N 


N 












EIB 3 


.417 


742 


.318 


718 


EIB 4 


.450 


636 


.425 


623 


EIB 5 


.550 


735 


..468 


722 


EIB 6 


.361 


716 


.278 


703 


EIB Total 


.610 


636 


.525 


623 


BSBI A 


.242 


522 


.249 


499 


BSBI B 


.484 


522 


.435 


499 


BSBI C 


.299 


522 


.294 


499 


BSBI D 


.462 


522 


.428 


499 


BSBI Total 


.507 


522 


.479 


499 


CFE 


.481 


717 


.482 


687- 



* All Correlations are significant at 0,01 



Interpretation : It is apparent from the Newman-Keuls test results shov;n in 
Taoles 18 and 19 that student outcomes in cognitive inquiry as measured by the 
instrument EIB-Topic 1 were related to both DAT-Verbal and Numerical scores 
since there v/ere a number of significant differences betv/een the various 
quartile subgroups. The correlation coefficients for EIB-Total scores (the 
coefficients indicating significant positive linear relationships) also support 
this view. 

Tables 18 and 19 also show that student outcomes for affective qualities 
measured by the BSBI were related to DAT-Verbal scores. Only two pairwise 
comparisons for SSBI - subscale D show significant differences; BSBI-total 
scores show no significant differences in pairv/ise comparisons. Therefore there 
does not appear to be a substantial relationship betv;een BSBI and DAT-Numerical. 
The correlation coefficient (.479) would support this view. This is as expected 
since the BSBI instrument is designed to measure affective qualities. 

in the comparison of CFE to DAT-Verbal, only one quartile pairing, 1st to 
4th, showed a significant difference (p - .05). Two pairings shov/ed significant 
differences when CFE and DAT-Numerical were compared (1st to 3rd, p = .05; 
1st to 4th, p = .01). CFE and DAT scores therefore were apparently related, but 
not to the degree shown for EIB and DAT scores. This view is again supported 
by the correlation coefficients (r = .481, CFE-DAT- Verbal ; r = .482, CFE-DAT- 
Numerical ) . 

SUB-PROBLEM 4: Are there significant differences in student outcomes in biology 
content knowledge, cognitive inquiry skills, and affective qualities of inquiry 
(measured by CFE, EIB-1 , and BSBI, respectively) between students in Inquiry 
Role Approach classes and students in non-Inquiry Role Approach classes? 
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HYPOTHESIS 4: There is no significant difference in student outcomes in biology 
content knowledge, cognitive inquiry skills, and affective qualities of inquiry 
among students grouped by: Classes of IRA teachers using the BSCS Yellow Version 
text, classes of experienced IRA teachers (that is, having previous experience 
using IRA) using the BSCS Blue Version text, and classes of non-IRA teachers 
using the BSCS Yellow Version text. 

Data Analyses/Results : It is important to first identify which teachers' 
students were included for these analyses. As DAT scores became available it 
was readily noticed that the DAT mean scores for students in the three groups 
given above (IRA Yellow Version classes, IRA Blue Version classes, non-IRA 
Yellow Version classes) were not equal. Particularly, IRA Yellow Version classes 
were well below the other student groups. Since it would be inappropriate to 
simply eliminate selected students with low DAT scores from the analyses, a 
decision was made to delete groups of students with low DAT mean scores. Thus 
teacher 01 "s students (mean score DAT-Verbal = 24.03; mean score DAT-Numerical 
= 17.73) were deleted as a group. (It should also be noted that teacher 01 did 
not meet criteria for adequate IRA implementation, and therefore student outcomes 
would not be considered valid IRA results.) In addition, teacher group lO's 
students (mean score DAT-Verbal = 28.22; mean score^ DAT-Numerical = 18.11) were 
deleted as a group. (Teacher group 10 represented a unique team teaching 
implementation design with no matching control group on this variable.) These 
deletions raised the IRA Yellow Version students' mean DAT scores fv-om 29.01 to 
30.71 on the Verbal and from 21.12 to 23.87 on the Numerical. This was an 
increase from approximately the 6l -h to 65th percentile on the Verbal and from 
the 40th to the 50th percentile on the Numerical (using 10th grade, first 
semester norms). Therefore all analyses using IRA Yellow Version scores include 
data from students of all teachers except teacher 01 and teacher group 10. 

Students* scores from all eight control teachers (non-IRA Yellow Version) 
were included in the EIB and CFE analyses. Three teachers did not administer 
the BSBK 

The contriDl group (students of all eight teachers) had a mean DAT- Verbal 
score of 32.73 (70th percentile on 10th grade first semester norms) and a mean 
DAT-Numerical score of 26.40 (63rd percentile). These DAT mean scores were 
not significantly different for the students of the five teachers included 
In the BSBI analysis. 

In order to determine if the primary experimental (IRA-Yellow) group student 
means for verbal and numerical ability v/ere different from the respective means 
for the control group, a t-test was utilized. The results are shown in Table 21. 

TABLE 21: Comparison of IRA and non-IRA Yellow Version 
Students* DAT- Verbal and Numerical Mean Scores 





DAT - (X) 
IRA N-IRA 


S.U. 

IRA N-IRA 


N 

IRA . N-IRA 


t 


P 


Verbal 
Numeric 


30.71 32.73 
23.87 25.40 


9.05 8.99 
7.28 7.49 


668 487 
656 487 


• 3.74 
5.62 


.01 
.01 
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Thus the control (non-IRA Yellow Version) group had significantly superior 
DAT-Verbal and Nunierical ability over the experimental group (IRA-Yellow 
Version) used in the following analyses. However, percentile comparisons, as 
noted earlier, were improved by the deletion of teachers 01 and 10. Further 
depletion of the experimental group to raise mean DAT scores would not be 
greatly improved unless a large number of groups were deleted. 

The experienced IRA Blue Version teachers reported a student DAT- Verbal 
mean score of 31.72 (68th percentile) and a student DAT-Numerical mean score of 
24.68 (55th percentile). Teacher 64 did not report DAT scores but it was 
assumed his students are nearly the same since they are within the same district 
as students of teachers 61 and 62. Note that CFE and BSBI analyses included 
students from all four of these teachers. EIB analyses, hov/ever, included data 
from one teacher, 64; the others did not administer the EIB instrument* 

In order to determine if there vjere any significant differences among three 
groups of teachers' students on any of the posttest scores, a one-way analysis 
of variance was applied to each of the student outcome variables. The results 
of these analyses are presented in Tables 22 through 29. 

Note that the EIB subscales reported in previous analyses are not included. 
Data from non-IRA and experienced IRA teachers was not scored by subscales. The 
EIB-Part lA score includes subscales I, III and 12 items in subscale IV. The 
EIB-Part IB score includes 12 additional items from subscale IV and subscales 
V and VI. 

TABLE 22: Comparison of IRA Blue and Yellow Version Teachers with Non-IRA 
Yellow Version Teachers on EIB-IA Posttest Student Mean Scores 



GROUP 


N 


MEAN 


S.D. 


F RATIO 


P 


IRA - Yellow 
Non-IRA - Yellow 
IRA - Blue 


607 
307 
29 


20.71 
18.33 
19.59 


4.89 
6.08 
5.34 


20.41 


.0000 



TABLE 23: Comparison of IRA Blue and Yellow Version Teachers with Non-IRA 
Yellow Version Teachers on EIB-IB Posttest Student Mean Scores 



GROUP 


N 


MEAI^I 


S.D. 


F RATIO 


P 


IRA - Yallow 
Non-IRA - Yellow 
IRA - Blue- 


592 
294 
29 


41.35 
37.33 
41.48 


7.73 
9.95 
7.40 


22.38 


.0000 
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TABLE 24: Comparison of IRA Blue and Yellow Version Teachers with Non-IRA 
Yellow Version Teachers on BSBI Subscale A (Curiosity) Posttest 
Student Mean Scores 



GROUP 


N 


MEAN 


S.D. 


F RATIO 


P 


IRA - Yellow 
Non-IRA - Yellow 
IRA - Blue 


435 
141 
107 


2.73 
2.53 
2.81 


.67 
.73 
.66 


6.49 


.0020 



TABLE 25: Comparison of IRA Blue and Yellow Version Teachers with Non-IRA 
Yellow Version Teachers on BSBI Subscale B (Openness) Posttest 
Student Mean Scores 



GROUP 


N 


MEAN 


S.D. 


F RATIO 


P 


IRA - Yellow 
Non-IRA - Yellow 
IRA - Blue 


435 
141 
107 


3.74 
3.37 
3.79 


.67 
.74 
.58 


18.59 


.0000 


26: Comparison of IRA Blue and ) 
Yellow Version Teachers on E 
Posttest Student Mean Scores 


fellow Version Teachers wi 
JSBI Subscale C (Satisfact 


GROUP 


N 


MEAN 


S.D. 


F RATIO 


P 


IRA - Yellow 
Non-IRA - Yellow 
IRA - Blue 


435 
141 
107 


3.61 
3.46 
3.74 


.68 
.75 
.68 


5.18 


.0061 



Non-IRA 



TABLE 27: Comparison of IRA Blue and Yellow Version Teachers with Non-IRA 
Yellow Version Teachers on BSBI Subscale D (Responsibility) 
Posttest Student Mean Scores 



GROUP 


N 


MEAN 


S.D. 


F RATIO 


P 


IRA 


- Yellow 


435 


3.90 


1.05 


9.07 


.0003 


Non- 


IRA - Yellow 


141 


3.58 


1.03 






IRA 


- Blue 


107 


4.12 


.94 







TABLE 28: Comparison of IRA Blue and Yellow Version Teachers with Non-IRA 
Yellow Version Teachers on BSBI Total Posttest Student Mean 
Scores 



GROUP 


N 


MEAN 


S.D. 


F RATIO 


P 


IRA - Yellow 
Non-IRA - Yellow 
IRA - Blue 


435 
141 
107 


13.98 
12.93 
14.46 


2.28 
2.53 
1.92 


17.05 


.0000 
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TABLE 29: Comparison of IRA Blue and Yellov/ Version Teachers with Non-IRA 
Yellow Version Teachers on CFE Posttest Student Mean Scores 



GROUP 


N 


MEAiJ 


S.D. 


F RATIO 


P 


IRA - Yellow 
Non-IRA - Yellow 
IRA - Blue 


558 
310 
89 


21.22 
24.17 
17.97 


6.25 
6.39 
7.22 


39.63 


.0000 



Application of the Hartleys '"max test to each analysis demonstrated that 
the homogeneity of variance assumption underlying analysis of variance was 
satisfied in each case. 

From Tables 22 to 29 it can be seen that all of the F ratios for comparing 
the three groups of teachers were significant beyond the .01 level of significance, 
indicating that there were significant differences among the posttest means 
for all of the student outcome variables. In order to determine which pairv/ise 
means were significantly different, the Newman-Keul^ A Posteriori test was computed 
for all pairs of means. The results of this analysis are presented in Table 30. 

TABLE 30: Table of Pairwise Differences at the .05 Level of significance 
as Indicated by the Newman-Keuls A Posteriori Test 





GROUP It^ 


GROUP 1 


GROUP 2 


TEST 


'GROUP 2 


GROUP 3 


GROUP 3 


EIB lA 


* 






EIB IB 


* 




* 


BSBI A 


* 




* 


BSBI B 


* 




* 


BSBI C 






* 


BSBI D 


* 




* 


BSBI Total 


* 




* 


CFE 


* 


* 


* 



f Groups: 1. IRA - Yellow Version 

2. Non-IRA - Yellow Version 

3. IRA - Blue Version 



All of the comparisons of the IRA Yellow Version teachers' students with 
the non-IRA Yellow Version teachers' students were significant (P = .05) except 
for the BSBI sub scale C score. Of those comparisons showing a significant 
difference, the IRA Yellow Version teachers' students were significantly higher 
for all of these differences except for the CFE scores. On the CFE, the non-IRA 
Yellow Version teachers' students scored significantly higher than both the IRA 
Yellow Version and IRA Blue Version teachers* students, and -the IRA Yellow 
Version students scored significantly higher than the IRA Blue Version students. 

All of the comparisons of the students of the IRA Blue Version teachers with 
the non-IRA Yellow Version students were significant (P = .05) except for the EIB 
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lA scores. For those comparisons showing a significant difference, the students 
of the IRA Blue Version teachers were significantly higher than the non-IRA 
students in all comparisons except for the CFE scores. As noted above, the IRA 
Blue Version students were significantly below both the IRA and the non-IRA 
Yellow Version students on the CFE. 

The only paiwise comparison between the IRA Yellow Version with the IRA 
Blue Version students that was significant was on the CFE. All of the other 
comparisons involving these tv/o groups of students were not significant at the 
.05 level. 

Interpretation : Despite the superiority by the control group in verbal and 
numerical ability as measured by the DAT, the IRA student groups had significantly 
superior posttest scores to the control group in cognitive inquiry and affective 
qualities of inquiry. These results were particularly meaningful for evaluating 
the effectiveness of the IRA program in light of the fact that the IRA program 
has been developed to operational ize the attitudinal and cognitive inquiry 
objectives delineated in Inquiry Objectives in the Teaching of Biol ogy (Bingman 
et^ aj^. , 1969). These results indicate that^the IRA program is an effective 
teaching approach for developing cognitive inquiry skills and affective qualities 
of inquiry which have been previously recognized by science educators as important 
goals of science teaching. 

Note that these results on the EIB and BSBI analyses also supported the 
validity of the IRA Yellow Version students* pre to post gains presented and 
discussed in Sub-Problem 1. 

With respect to the posttest biology content instrument, CFE, student mean 
scores for the non-IRA - Yellow Version group significantly exceeded the scores 
for the IRA- Yellow Version Group. This finding should be interpreted in terms 
of the differences in the two student groups on DAT scores (Verbal and Numerical), 
the standard error of measurement reported in the CFE Manual, and the quantity of 
content coverage in the IRA Yellow Version Groups- 
Part of this difference may be due to the significant differences in the 
DAT scores (Verbal and Numerical) reported on Tabel 22 which was significantly 
higher for the non-IRA Yellow Version group. 

Another factor to consider is that the difference in the mean scores for 
the two groups (2.95) is within the standard error of measurement (3.1 to 3.3) 
reported in the CFE Manual. 

It is possible that some of the difference in the obtained scores can be 
attributed to measurement error and does not represent "true" difference in the 
scores of the two groups. 

Note, that the first two IRA themes treat 41 per cent of the chapters in 
the BSCS Yellow Version Text; the majority of IRA Yellow Version teachers 
completed only 11 per cent of Theme III activities. The low extent of biology 
content treatment indicated by this information, plus IRA teachers own statements 
that content treatment v/as reduced from previous years when IRA was not used, 
indicate that the lov/er CFE scores may be due in part to reduced biology content 
treatment. (Interviews of both IRA teachers and non-IRA teachers in previous 
IRA studies showed that IRA teachers treated at least 25 per cent fewer text 
chapters than non-IRA; it is reasonable to assume that this disparity of treat- 
ment also existed in the 1972-73 field test study.) 
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In light of the probable disparity of content treatment and differences in 
CFE posttest scores, it can be implied that in using the IRA program and in 
thereby expanding course objectives to include cognitive inquiry and affective 
qualities development, teachers must be av/are that some reduction in the scope 
of biology content treated may be necessary. It should be pointed out, hov/ever, 
that in previous studies (1969-79, Bingman, et al . , 1970, p. 30; 1971-72, 
unpublished data) IRA classes scored significantTy higher on CFE posttests than 
non-equivalent non-IRA classes; groups v/ith equivalent DAT scores v;ere used in 
these studies. 

The Yellow Version IRA groups scored significantly higher than Blue Version 
IRA groups on CFE scores. There appeared to be no particular reason to believe 
that differences in DAT scores, measuring error, or differences in the treatment 
of subject matter coverage in the course should account for these differences. 
Also previous experience in studies conducted in local IRA Blue Version classes 
have shown that the students scored much higher than found in this study. 

Part of the difference can probably be attributed to fifty per cent of the 
students included in the Blue Version sample for CFE being 9th graders. Based 
on previous experience with 9th grade students the investigators as v/ell as 
the CFE Manual authors have found considerable differences in scores favoring 
10th graders. Otherwise, the differences in these results remain unexplained. 

In summary, the students of IRA Yellow Version teachers have shown signifi- 
cantly higher posttest scores on instruments measuring cognitive inquiry skills 
and affective affective of inquiry than students of non-IRA Yellow Version 
teachers. This suggests that the IRA program is an effective teaching methodology 
for the development of cognitive inquiry and affective qualiteis of inquiry. 
Students of non-IRA Yellow Version teachers have shown significantly higher 
posttest scores on an instrument measuring biology content knowledge than 
students of IRA Yellow Version teachers. This difference may be due in part to 
non-equivalent verbal and numerical abilities of the IRA and non-IRA students, 
error in measurement and to the probable disparity in biology content treated in 
the IRA and non-IRA classes. This result is also not consistent with results of 
two previous studies. 

The Yellow Version IRA classes have shown significantly higher posttest 
scores on the CFE instrument than the Blue Version IRA classes. Other than the 
grade level difference in the two groups, the results appear inconsistent with 
past studies. 

SUB-PROBLEM 5: What revisions in the program materials are indicated by the 
results of testing, student feedback, and teacher feedback? 

Feedback was received via the Teacher's Log (a report filed by each teacher 
after each activity), other written correspondence from teachers, telephone 
conversations, on-site visits by program staff with teachers and students, 
student feedback on Views and Preferences - C (Seymour and Bingman, 1973) and 
Class Activities Questionnaire (Steele, ejt aX. , 1971), and testing data. 
Information from all sources was summarized by IRA staff; all summaries were 
checked by two other staff members to insure that agreement was reached that 
the summary conveyed the major issues from the original communication. V&P-C, 
CAQ, and testing data were represented by the analyses which have been reported 
here and in the other papers of this paper set. 
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A copy of the Teacher's Log instrument (reduced one-half) is shown belov;. 
When teachers reported information via other means (other v/ritten communications, 
telephone conversations, etc.), the information provided was generally similar 
to that asked for on the Teacher's Log. 



,M !t«nf HO 

1. ACTIVPT '.WLitU 

If ^r.f Pdrl or jK o' 'hp dctivity wtiS ulCd. 
cir<lt . if no pd't of tfte jctuit/ wjs 
used, cTrTl* 

2. IN-CLASS TIMt SPENT ON ACTIVITY: 

Indicate tl'ae In mlojtes to the ncamt 
ten ifJnutcs '.hit /Ou «nd your studoti 
ip«ftt \f\ c]m oi> th)^ #ct;/1t/. 

3. MOOlf:CATlO.NS IN ACTIVITY PaOCEOCSCSr 

If yOtf fo)loti} t*'c procedurr,.| ^Jtftout in/ 
na<iStic*tScn\, circtp 'f you irodtfKd 
*ny pArl or Ofltltted « part, cirtle jrri. 

4. EXPLAIN MOOIFlCftriONS YOU HAjt W»0 WM: 



5 ctsEOAL ;;wiiWj 



5lve any 'tactiyRj you ^a^(e to me ictivlty, triinmg o'* tht .^rcqrin 
raquir^tnonti !'»cJj'3« /Ojr optniooi oo the activity sequence ■ -should 
(I hive been 'oM;,'wej pr«cede«J ^y i^cther actwity, «r)g!d you 
Su9^«st another sentience? 



A. SPtClfiC R£ACTlOf<$ TO PR£- AND iN- CLASS IhSIRUCTIOftS- 



SPECIFIC RUCTIONS TO STUOtNI WTtRlALS: 



P£9C£NTAGC or STUOCNTS KUIING CRITERIA fC? ^JECTIVCS: 

Esdm^tc (he percentA^e of sludenls who reached the crlUr1« 
specified In the objectives. 



7. HOW COUlO THIS ACTIVITY e£ IMPROVLD? 

Suggest how this activity <tould be inoroyed to better meet tht 
Specified objectives or objectives you would Include. 



Interpret at ion: Of the 36 activities for which feedback was summarized fourteen 
required major changes. (There were eight activities for which ?oo ^?ttle 
feedback was received to meaningfully evaluate; two additional activities were 
designed only for data collection purposes). 

H.VoJLnc°l!^^u^ "1°^^^' however, that changes generally dealt with better 
directions to the teacier (more direction to execute activity, more accurate 
Jr^tr^n^pc '"?'"^ complete discussion of expected student outcomes or assessment 
of outcomes, etc.) or changes in clarity or usefulness in student materials 
(shorten student forms, clarify statements, etc.). Recormiendations to delete 
activities or major parts of activities, to redirect the activity to new goals 
to substitute other activities, etc.. were only suggested in response ?o the 
introductory activities, 101 to 105. Even when such changes were suggested! 
common elements of an initial orientation to the IRA program were found in all 
teacner suggested revisions. The specific changes recommended have been 
previo-usly reported (Seymour, et al., 1973). ' 
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Aside from the specific activity-by-activity recommendation, two general 

?uidelines for revision resulted from the teacher feedback and testing data: 
1) As much as is possible, reduce the number of student forms. Specific 
suggestions for deletion were seldom given, Hov/ever, teachers felt that the 
number of stuHpnt forms was overv;helming to students as v/ell as difficult for 
teachers to manage from a simple logistics viewpoint, (Student forms have been 
reduced from 213 pages to 110; note, however, that about 60% of this reduction 
is due to changes in format and printing,) (2) More complete treatment of the 
biology text content is desirable. Low scores (of IRA students compared to 
non-IRA students) in biology content appeared to be attributable, at least in part, 
to the fact that few IRA teachers completed the program. Thus several sections 
of the-text were not directly treated in the instructional materials used. This 
too has been addressed in revision, IRA activities have been reduced from 46 to 
41, with at least one activity being optional, A larger portion of text 
material is directly referred to in Themes I and II activities. In addition, 
the clarification and f^impl i f ication of both student j'orms and teacher directions 
should enhance more rapid completion of program activities. 

In general, feedback suggests that the IRA materials were founo to be 
adequate for implementation in the classroom and satisfactory to teachers in 
terms of usability. 

Summary : 

Student outcomes in the 1972-73 Inquiry Role Approach field test are 
reported and discussed. Using the Comprehensive Final Examination, Exploration 
in Biology-Topic 1, and Biology Student Behavior Inventory, Inquiry Role 
Approach students were found to make significant pre-to-post gains in biology 
content understanding, cognitive inquiry skills, and in curiosity, openness, 
and responsibility. In addition, student mean scores on the Social Skills 
Checklists and Attitude Checklists met the criterion levels, indicating attainment 
of desired social skills and attitudes. 

Student outcome differences for students grouped in quartiles based on verbal 
reasoning and numerical ability aptitudes (Differential Aptitude Test) generally 
showed differences betv/een students in low and high quartiles for scores on the 
Exploration in Biology-Topic 1 (measuring cognitive inquiry skills) but not for 
scores on the Biology Student Behavior Inventory (measuring attitudes) or the 
Comprehensive Final Examination (measuring biology content understanding). 

Student outcome differences between Inquiry Role Approach students and 
non-Inquiry Role Approach students indicated significantly greater development 
of cognitive inquiry skills and attitudes for IRA students over non-IRA, and 
significantly higher biology content understanding for non-IRA students over IRA, 

Data from teachers, students, and testing results have been used to revise 
the IRA instructional materials. The data used and generally characterization of 
the revisions are discussed. 
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